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DEVICE INTFTROPFR A BILITY UTILIZIN G BTT-MAPPFD 
ON-SCREEN DISPLAY MENUS 

Field of the Invention 

The invention involves a system for controlling multiple electronic 
devices, such as consumer electronic devices or the like, via 
interconnections such as digital data buses. More particularly, this 
invention concerns an arrangement for managing the interoperability 
of the On-Screen Display menus of such devices. 

Background of the Invention 

A data bus can be utilized for interconnecting digital electronic 
devices such as television receivers, display devices, video-cassette 
recorders (VCR), direct broadcast satellite (DBS) receivers, and home 
control devices (e.g., a security system or a temperature control 
device). Communication using a data bus occurs in accordance with a 
bus protocol. Examples of bus protocols include the Consumer 
Electronics Bus (CEBus) and the IEEE 1394 High Performance Serial 
Bus. 



A bus protocol typically provides for communicating both control 
information and data. For example, CEBus control information is 
conmiunicated on a "control channel" having a protocol defined in 
Electronics Industries Association (EIA) specification IS-60. On an 
IEEE 1394 serial bus, control information is generally passed using the 
asynchronous services of the serial bus. Control information for a 
particular application can be defined using for example, Common 
Application Language (CAL) or AV/C, 

In today's analog audio/video (AA^) cluster, controlling peripheral 
devices may include, but do not require, the activation of an On- 
Screen Display (OSD) mechanism on a display device (Le., TV). The 
OSD of such A/V devices is generated in the peripheral or target 
device (e.g., VCR) and is output on the NTSC output of such devices 
the same way as any other video signal. Thus, no additional 
hardware or software is needed in either the peripheral or the 
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display device. Figure 1 illustrates a present A/V system 10 having a 
VCR 12 and a display device 14 (e.g., television) that employs such a 
control methodology. Menus associated with controlling VCR 12 are 
generated by the VCR 12 and are provided to the display device 14 
via the NTSC output of the VCR 12 as a composite video signal. 

Summarv of the Tnvpnri r>n 

Unfortunately, to use the same approach (See Figure 2) with a digital 
TV (DTV) as a display device 12 is not practical since it would require 
the menus to be transported as MPEG-2 transport streams. Generation 
of such streams necessitates integrating an MPEG encoder 15 into all 
peripheral devices which greatly increases the cost and complexity of 
such consumer electronic devices. 

The present invention provides for exchanging on-screen display 
(OSD) menus and associated control between common consumer 
electronic (CE) devices interconnected via a digital serial bus. The 
serial bus is used for the physical and link layers; a control language 
for managing OSDs and controlling the connectivity of devices 
interconnected via the bus. Particularly, this invention provides for 
transferring bit-mapped OSDs which are created and controlled by the 
target device to a display device and combining the bit-mapped OSDs 
with a digital video stream received by the display device. In the 
preferred embodiment, the transfer of the bit-mapped OSD menu is 
managed by trigger messages sent from the target to the display 
device. 

The present invention permits the selection of a target or source 
device (e.g., DVCR) for the display device (e.g., DTV), thereby allowing 
the target device to display both content and an OSD on the display 
device. Further, the user may select a source for the target device; 
this allows the chaining of devices so that for example, a program 
which is bemg decoded by a Cable STB may be viewed on a DTV and 
recorded on a DVHS recorder simultaneously. 

Another aspect of the present invention involves remote navigation; 
that is the device that is being controlled keeps track of the user's 
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navigation through the menu. For example, a VCR (i.e., target) makes 
its own changes to the OSD to move the highlight around with no 
participation from the display device (i.e., TV). This is accomplished 
utilizing OSD update blocks as described below. 

Brief Description of the Drawings 

The invention may be better understood by referring to the 
enclosed drawing in which: 

Figure 1 shows, in simplified block-diagram form, the 
interoperability of a prior art audio/video system; 

Figure 2 shows, in simplified block-diagram form, the 
interoperability of a digital VCR and a digital television; 

Figure 3 shows, in simplified schematic block-diagram form, the 
interoperability of digital devices employing the present invention 

Figure 4 shows, in simplified schematic block-diagram form, a 
display device having an on-screen display menu constructed using the 
present invention; 

Figure 5 shows, in simplified schematic form, the display device's 
construction of the on-screen display menu of Figure 4; 

Figure 6 shows, in simplified schematic form, the modification of 
the on-screen menu of Figure 4; and 

Figure 7 shows, in simplified schematic block diagram form, the 
pixel mapping for different resolutions of on-screen display menus of 
the present invention. 

In the drawing, reference numerals that are identical in different 
figures indicate features that are the same or similar. 
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Detailed Descri ption of the Drawings 

The use of IEEE 1394 serial bus has been suggested for many 
applications within a Home Network environment. It is being 
discussed within Video Electronics Standards Association (VESA) for 
use as a "whole home network." It is being built into the next 
generation PCs and will be used for many local peripherals including 
disc drives. Further, digital audio/video consumer electronic devices 
such as digital televisions (DTVs) and digital video cassette recorders 
(DVHS) may utilize a serial bus for interconnecting these devices. 

IEEE- 13 94 is a high speed, low cost digital serial bus developed for 
use as a peripheral or back-plane bus. Some of the highlights of the 
bus include: dynamic node address assignments, data rates of 100, 
200, and 400 Mbits/sec, asynchronous and isochronous modes, fair 
bus arbitration, and consistency with ISO/IEC 13213. Co-pending 
applications; Attorney Docket Numbers 88,761 and 88,823 discuss the 
use of IEEE- 13 94 serial bus for interoperability of audio/visual 
devices. 

Transferring On Screen Display Menus (OSDs) from a target {i.e., 
device to be controlled) to a display device (e.g., DTV ) can be 
achieved using one of several formats. For example, a subset of HTML 
without the navigation features may be used to describe the OSD. 
Another possibility is to transfer a run-length-encoded version of the 
menu using something similar to the DVD subpicture format. 
However, the preferred embodiment involves transferring the actual 
information in an OSD bit-map format. For example, an 8 bit/pixel, 
full screen, 640X480 OSD can be transferred in about 100 msecs 
utilizing 10% of the bandwidth of the 200 Mbit/ sec IEEE 1394 serial 
bus. 

A bit-map format for the OSD description allows (1) the manufacturer 
to maintain the "look and feel" of the OSD, (2) for freedom in the 
generation of the OSD and (3) for dynamic updates (i.e. partial screen 
or even single pixel updates are possible). Compared to compressed 
representations, the bit-map representation requires less processing 
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time to display because displaying such bit-mapped OSD menus 
requires minimal interpretation and manipulation. Descriptive 
approaches, such as HTML, have a disadvantage of being difficult to 
specify and upgrade for typical consumer products. 

To simplify the transfer of bit-mapped OSD information, a "Pull" 
method is preferably utilized. With this method, the bulk of the OSD 
data is transferred from the target or peripheral device to a display 
device by asynchronous read requests issued by the display device. 
That is, the display device reads the OSD information from the 
memory of the peripheral device by making use of at least one block 
read transaction of IEEE 1394. The display device is informed of the 
location and size of the OSD data via a "trigger" command which is 
sent from the peripheral device to the display device when the 
peripheral device is ready to begin transferring data. 

Other alternatives for transferring an OSD menu from a peripheral 
device to a display device include; (1) an asynchronous push method 
which primarily uses IEEE 1394 asynchronous write transactions 
initiated by the peripheral device to write the OSD data into the 
display device, (2) an isochronous transport method for broadcasting 
the OSD data over one of the isochronous channels provided by IEEE 
1394, (3) an asynchronous stream method for carrying the OSD 
information and (4) Alternately, the bit-mapped OSD could be 
provided via a 8 VSB-T{trems) or 16 VSB RF remodulated channel. 

Figure 3 defines a system 10 for providing interoperability between 
digital A/V devices interconnected via an IEEE 1394 serial bus. In 
such a system 10, interoperability may be achieved by transferring 
the on-screen display (OSD) menu directly from the peripheral or 
target device 12 (e.g., DVCR) to display device 14 (e.g., DTV) utilizing 
the "Pull" method. The menu is not transferred as a composite video 
stream which would require first passing the menu information 
through a MPEG encoder contained in the peripheral device. The 
menu is transferred as a bit-mapped OSD via serial bus 16 to DTV 14 
where the menu information may be overlayed in DTV 14 with the 
decoded MPEG stream prior to being displayed. 
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Many of the devices may use a registry table that is built during a discovery 
process which looks at information stored in each instrument's Self Describing 
Device Table (SDDT). The SDDT may contain such information as a unique ID, 
5 node address, etc. The registry tables would be used by the DTV to build a menu 
to allow the user to set up connections between components (similar to the user 
selecting the composite input for the source of their TV today). The target device 
first checks the display format and the largest available block fields within the Self 
Description Device Table (SDDT) to see what size and resolution OSD can be 
10 handled. It then constructs the OSD data (header and bit-map) and stores it in its 
OSD memory area. 

As shown in Figure 4, an OSD menu 18 constructed on a display 14 consists of 
an OSD Region 20 and OSD Update Blocks 24 (OSDUB1 through OSDUB2). 

15 The data defining an OSD Region consists of a single color map contained in the 
Main OSD Header. Each OSD Update Block consists of an OSD Update Block 
Header and bit-map. The update blocks used to construct the OSD Menu are 
acquired from the target (e.g., VCR) by the display device to be used in 
constructing the OSD. The OSD Update Blocks are transferred from the target to 

20 the display device over the serial bus. 

Once the OSD information is ready for transfer, the target sends a trigger 
message to the display device (see Figure 5). These same trigger messages are . 
used for both the main OSD Header as well as the OSD Update blocks 24. A 
25 unique trigger message is needed for each OSD Update Block 24. Initiation of an 
OSD Update Block transfer can only occur through the use of a trigger message 
from a target to the display device. A queue may be implemented in the display 
device so that trigger messages are processed in the same order in which they 
are received. 

30 

The trigger messages 22 will be processed in the order in which they are sent out, so 
it is important for the target to know which OSD Update Block belongs on the bottom 
and which one belongs on the top. For example, a trigger message for OSD Block 0 
(the Main OSD Header and Palette) is sent out first, followed by the trigger message 
for OSD Block 1 , etc. Effectively, the first update block ends up on the 
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bottom and the last update block on the top. (That is, an OSD Menu 
may be constructed in steps where each subsequent step may 
overwrite a portion of a previous step.) This allows for JSD blocks to 
be constructed on the fly thereby keeping memory requirements low. 

The bit map immediately follows the header for each OSD block. The 
OSD pixels that are stored in memory are a 4:4:4 representation of 
chroma/luma levels set from palettes. Each palette entry contains a 
transparency (T) bit, a blending (B) bit, 6 bits of Y, 4 bits of Cb, and 4 
bits of Cr. The transparency bit and the blending bit for each entry 
allow the target to selectively display either an OSD pixel, a video 
pixel, or a blended pixel on a pixel and pixel basis. 

After a trigger message is received from the target, the OSD module in 
the display device requests memory accesses (i.e., asynchronous 
reads) starting at the memory location specified in the trigger 
message. If the OSD is entirely new, the first trigger message should 
refer to the Main OSD Header and Palette. Once the display device has 
this information, it then requests information specified in the second 
trigger message (i.e., OSD Update Block 1). The display device reads 
all of the information associated with OSD Block 1 and begins to 
construct the actual bit-map image. At the same time, it informs the 
target that the block has been read so that the target may free up any 
memory it had allocated to the transfer of this data block. This image 
is then displayed. If additional trigger messages have been received, 
then those OSD Update Blocks are processed in the same way. The 
display device's OSD controller (not shown) uses this data to construct 
the OSD and mix it with the decoded MPEG video in DTV 14. The OSD 
Update Blocks stay on the screen until they are overwritten, cleared, 
or the user selects a different device. 

Before a color component is displayed, it is "left justified" by the OSD 
Controller (i.e., the least significant bits being padded with zeros) to 
produce 8 bits each of Y, Cb, and Cr. The 4:4:4 representations will be 
muxed into 4:2:2 MPEG video output by the display controller internal 
to the display device. 
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After receiving the pixel data for block 1 , the OSD module reads the 
header for block 2, obtains the necessary information and then reads 
the pixel data associated with block 2. The OSD module repeats this 
5 process (read header, request data using the address, get pixel data, 
etc.) up through the point that the DTV selects a different source. 
This data is then stored in the proper format internal to the display 
device. The Display device's OSD controller uses this data to construct 
the OSD and mix it with the decoded MPEG video. 

10 

Updates occur in exactly the same way that the original OSD is built 
with the exception that there would be no need to transfer the Main 
OSD Header and color palette unless the color palette or spatial 
resolution has changed. Based on the input from a remote control 

15 (directly or indirectly), the target constructs the desired OSD Update 
Block(s) in its memory. These blocks may be very small and will 
likely overlap with the OSD already being displayed. Once the 
block(s) are ready, the target sends out the appropriate trigger 
message(s). After the trigger message(s) is received from the target, 

20 the OSD module in the display device requests memory accesses 
starting at the memory location specified in the trigger message. 
These OSD Update Blocks are processed and overlaid over the existing 
OSD in the same order that the trigger messages were received. The 
display device again informs the target of a successful read so that 

25 the target can free up any internal memory that it has allocated to the 
block transfer. Exactly like the original OSD, these blocks stay on the 
display until overwritten. 

Various views may be constructed within the target and then 
30 properly displayed by the display device. When a change is made, 
the target determines how the displayed OSD is affected and sends 
the proper Update Blocks to the display device. This scheme reduces 
complexity and bus traffic compared to the display device being 
required to keep track of overlays, 

35 

The amount of data to be transferred can be reduced by using a 
limited number of colors, using vertical line doubling and horizontal 
half resolution. For example, a 320X240 OSD can be displayed m 
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640X480 by specifying \/erticai1i'ne'doubiing and horizontal half resolution. If only 
4 bit color is used, then the amount of data that needs to be transferred is 
approximately 39 Kbytes. Assuming a 512 byte payioad every 500 usee, this 
OSD could be transferred in about 40 msec. Small updates would of course take 
5 much less time. 

Real-time encoded video may be achieved by transferring bit-mapped OSD 
menus. In this case, a 640X480 display using 8 bit color could be transferred at 
30 frames/second using a 74 Mbit/second Isochronous channel. Probably one 
10 such channel could be supported on the cluster. 

In addition to the starting location and size of the current OSD data to be 
transferred to a display device, a field indicating the type of the OSD data may be 
useful. For example, a user watching a movie may want to ignore status or error 
15 messages. The differentiation of the type of OSD data is helpful for the display 
device and/or user to decide whether the message should be displayed. 

The trigger message can also be used to inform the display device to read the 
Main OSD Header and color palette. Additionally, the trigger message will also 
20 be able to inform the display device to clear the OSD. Initiation of an OSD 

Update Block read can only occur through the use of a trigger message from a 
target to the display device. The display device should process the trigger 
messages in the same order as received. 

Figure 6 illustrates the use of a sub-region message 30 generated by the display 
device 14 for requesting the update of a specific sub-region 32 of the existing OSD 
Region 20 being displayed. This message may be useful in several situations such 
as when an error message from the display device or from some other device 
overwrites a portion of the existing OSD. The display device can request that this 
sub-region of the OSD be re-transmitted. Such a sub-region message would be 
useful when there is a change to the color map, but the display device did not save 
copies of the original OSD Update Bitmaps. Still another benefit of using a sub- 
region message would be when the user selects a different device and then comes 
back to the earlier device. The display device may need to 
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request some information to rebuild the display. Although a sub- 
region is requested as a block, it is possible that the shape of the OSD 
which was previously within that sub-region is not rectangular in 
shape. For this reason, the target may transfer the information for 

5 this sub-region to the display device in multiple OSD Update Blocks. 
This message will include the row/column start coordinates and the 
width/height of the sub-region. Please note however, that the target 
does not need to wait for such a message to display an OSD. Most of 
the time, it will initiate changes to its OSD based on incoming remote 

10 control messages. Trigger messages will be used to initiate the 
transfer of the OSDUB in either case. 

The OSD menu may be displayed properly over any of the below ATSC 
Video Formats. 

15 



Picture Size 


Frame Rate 


Aspect ratio 


1920 X 1080 


60i 




30p 


24p 


16:9 




1280 X 720 




60p 


30p 


24p 


16:9 




704 X 480 


601 


60p 


30p 


24p 


16:9 


4:3 


640 X 480 


601 


60p 


30p 


24p 




4:3 


i = interlaced p= progressive 



The general format of OSD menus being transferred from a target 
device to a display device involves first transferring a main OSD 
Header and secondly transferring a color palette. The OSD menu can 

20 be partially updated by transferring an updated OSD Header and the 
related bit-mapped menu. The Main OSD Header contains control 
information for the color map and general control information such as 
resolution, size of OSD area required, etc. The color map can be in one 
of 4 formats (2 bit color, 4 bit color, 8 bit color, no color map ) and 

25 also includes facilities for blending with background video. 

Main OSD Header 

The main OSD header is used to set the format of the following OSD 
menu. For example, the following header contains information (i.e., 
30 size of 640 X 480 pixels) about the entire OSD Region and about the 
color palette. Changes to the Main OSD Header are communicated to 
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the display device through the use of the trigger messages from the 
target. The defined OSD region is only valid as long as a target has 
been chosen as a source for a display device. 



Main OSD Header Format 



14 



OSD Header Type 
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7 1 6 


Verti 


Resolu 


cal 


tion 


line 


Mode 


doub 




ling 





Mix Weight 



1 



Color 
resolu 
tion 







gi|p|}||{|M ( 


DSD Region Height 


1 






iSBiiiiii OS 


'D Region width 


2 


TO 


BO 


color 0 Y 


color 0 Cb 


color 0 Cr 


3 


TI 


Bl 


color 1 Y 


color 1 Cb 


color 1 Cr 


4 


T2 


B2 


color 2 Y 


color 2 Cb 


color 2 Cr 


5 


T3 


B3 


color 3 Y 


color 3 Cb 


color 3 Cr 


6 


T4 


B4 


color 4 Y 


color 4 Cb 


color 4 Cr 


7 


T5 


B5 


color 5 Y 


color 5 Cb 


color 5 Cr 


8 


16 


B6 


color 6 Y 


color 6 Cb 


color 6 Cr 


9 


17 


B7 


color 7 Y 


color 7 Cb 


color 7 Cr 


10 


IS 


B8 


color 8 Y 


color 8 Cb 


color 8 Cr 


11 


T9 


B9 


color 9 Y 


color 9 Cb 


color 9 Cr 


12 


TIO 


BIO 


color 10 Y 


color 10 Cb 


color 10 Cr 


13 


Til 


Bll 


color IIY 


color 11 Cb 


color 11 Cr 


14 


T12 


B12 


color 12 Y 


color 12 Cb 


color 12 Cr 


15 


T13 


B13 


color 13 Y 


color 13 Cb 


color 13 Cr 


16 


T14 


B14 


color 14 Y 


color 14 Cb 


color 14 Cr 


17 


T15 


B15 


color 15 Y 


color 15 Cb 


color 15 Cr 


18 



The OSD Header field is used to distinguish the type of OSD Block 
which is being transferred from the target to the display device for 
example, Main OSD Header or Bit-map Update Block. 

10 

There is also the possibility to specify that each vertical line is 
doubled. For an interlaced display, this has the effect of specifying 
that even and odd fields be the same. When this mode is enabled, 
every line of the OSD is repeated once (i.e., duplicated). For example, 
15 by setting the vertical enable bit to true and sending 5 lines of OSD 
data to the display device, the OSD would produce 10 lines on the 
display output. It is necessary, then, for the target to set the Block 
Height to correctly correspond to the total displayed OSD lines (in this 
case, 10). 



20 
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The mix weight bits tell the OSD the blending ratio for OSD and video. 
For example, each bit may have a resolution of 1/16. The blending 
ratio ranges from 0 (transparent) to 15/16 (pixel almost solid). The 
same mix weight is used for all pixels that have their respective 
blending bit set (B[n]=l). The mix weight is ignored for palettes with 
blending disabled, resulting in solid OSD. 

The OSD Region Height and OSD Region Width define the height and 
width of the OSD Region (in number of pixels) which the target plans 
to use. A typical region may be 640X480. The display device may 
not display portions of OSD Update Blocks which fall outside of this 
region. Color Resolution bits defines the current resolution of the OSD 
as, for example, full, half, or third resolution. The combination of the 
OSD Region Height, OSD Region Width and Color Resolution effectively 
set the OSD layout. 

The color palette immediately follows the Main OSD Header. Each 
palette entry contains a transparency (T) bit, a blending (B) bit, 6 bits 
of Y, 4 bits of Cb, and 4 bits of Cr. Note that each of these 3 color 
components will be converted to a byte before mixing with MPEG 
video. Therefore, the bits associated with each field (e.g., Y) can be 
considered the most significant bits within that byte. For example, for 
luminance (Y), the 6 bits in the color map are the 6 most significant 
bits in a luminance byte. The transparency bit and the blending bit 
for each entry allow the target to selectively display either an OSD 
pixel, a video pixel, or a blended pixel on a pixel by pixel basis. 
Changes to the Color Palette are communicated to the display device 
through the use of trigger messages and subsequent read operations. 

The OSD pixels that are stored in memory are a 4:4:4 representation 
of chroma/luma levels set from the palette. The values in the bit- 
map are essentially indexed into the palette. Note that the color 
resolution of each block may be less than that specified for the 
palette. For example, if there are 256 entries in the color map (i.e., 8 
bits/pixel), then a specific OSD block may specify 2 bits/pixel, 4 
bits/ pixel, or 8 bits/pixel. If 2 bits/pixel are specified for the OSD 
block in this example, then these 2 bits would index into the first 4 
entries of the color map. If 4 bits/pixel are specified for the OSD 
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block, then these 4 bits would index into the first 16 entries of the 
color map. 

For the True Color Mode, the OSD hardware in the display device may 
extracts 4:2:2 data directly from the OSD FIFO (not shown), and send it 
5 out through the outputs, by-passing the normal palette look-up. All 
normal functions of the OSD are supported, except for the mixing 
function. Thus, the user may use this True Color mode in full, half, or 
third resolutions. Any pixel can be made transparent by setting its Y 
component to "0". Note that all data for the header block is assumed 

10 to be in 4:2:2 format in the following sequence: Yl, Cbl, Crl, Y2, Y3, 
Cb3, Cr3, Y4, ... Each component is 8 bits of data. In this format, both 
Yl and Y2 use the same Chroma components (Cbl, Crl). That is, each 
pixel is represented by a respective luma value and by a set of 
chroma information that is shared with a second pixel. For example, 

15 pixels 1 and 2 are represented by respective luma values Yl and Y2 
and a common set of chroma values Cbl and Crl. This results in an 
effective pixel size of 16 bits/pixel. As in palette-based mode, only 
even numbers of pixels are supported for OSD Update Blocks. The 
pixel format of the update block may be configured such that the 

20 upper left pixel is first, followed in a logical manner across first and 
down second to the final pixel located at the bottom right of the 
region. Again, the user needs to properly calculate the number of 
pixels per line required for the given resolution and line width. 



True Color Bit-map Format 



pixel 1 - Y 


pixel O&l - Cr 


pixel O&l - Cb 


pixel 0 - Y 


pixel 3 - Y 


pixel 2&3 - Cr 


pixel 2&3 - Cb 


pixel 2 - Y 


Etc. 









25 

High resolution displays can have 4 to 6 times the pixel density for 
the same size OSD area. To ease setup requirements and OSD 
transmission times, half resolution and one-third resolution modes 
are provided. These modes are available for both palette based OSD 
30 and true-color OSD. Figure 7 illustrates how individual pixels may be 
mapped to output pixels based upon the selected resolution. 
It is important to realize that it is up to the target to properly set the 
width of the OSD Region based upon the resolution mode. The starting 
column and width in the OSD Update Block Header directly correspond 
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to output display pixels of the display device (based upon the internal 
display pixel counter). For example, if the column start position is 
100 and the width is 100, then the OSD Update will begin displaying 
pixels at pixel count 100 and end at pixel count 199. Thus, this 
function is not dependent upon the resolution mode selected. If the 
resolution is Half, and the target wants to display this same set of 
pixels, then it would have to adjust the width to 200. The effect 
would be to see a horizontally "stretched" version of the original OSD 
picture. 

At a minimum, all display devices should be able to display a 
640x480 at 2 bits/pixel OSD using vertical line doubling and 1/2 or 
1/3 resolution mode for horizontal. For 1/3 horizontal mode, this 
would result in a 1920X1080 display with the resolution (and data 
transfer time) of a 640X480 display. 

The transfer of data (i.e., bit-mapped menus) through the bus may be 
achieved in a reasonable amount of time. For example all the data 
required for a 640x480 OSD with 4 bits/pixel requires 1,228,800 bits. 
All of this data can be transferred in about 150 ms assuming a 100 
Mb/ sec bus, a packet payload of 512 Bytes and assuming that we can 
transmit one packet each SOOjisec. This time goes down even further 
when one takes into account that no OSD takes up this much space. 
Using only a quarter (typical) of the entire screen results in roughly 
40 ms transfer time. Small updates can be on the order of a few 
milliseconds. 

OSD Ilndate Blocks 

An OSD Region is a defined area on the display screen. The region is 
filled using OSD Update Blocks (OSDUB) (See Figure 4). Each OSD 
Update Block defines a rectangular portion of the screen to be 
updated. Each block contains its own header information and bit- 
map. Each update block will remain on the screen until overwritten 
by another block or until a "Clear Region" trigger command is 
received. The target has full flexibility of the format of these blocks 
(taking into account the limitations of the display device). 
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The OSD Update Block's dimensions are absolute (in a pixel sense). Its 
coordinates are absolute within the OSD Region. The upper left hand 
comer of the OSD region is coordinate (0,0). The height/width of the 
displayed OSD Block will depend on the display format. If the 
transmission format changes, the OSD's appearance may change 
accordingly. If the transmission format changes, a message will be 
provided (see below discussion under Display Information) from the 
display device to the target letting the target know that the format 
has changed, allowing the target to re-specify the OSD if it desires. It 
is anticipated, that most OSDs will be mixed with the display format 
and will be unaffected by a transmission format change. However, 
the target may still want to redraw the OSD since the video may be 
occupying a different portion of the screen. 

The header for an OSD Update Block contains the start position within 
the OSD Region and the size of the block. The header (see below) 
contains two bits which designate the color resolution. This color 
resolution must be less than or equal to that specified in the Main OSD 
Header. 




The row start and the column start pointers define the upper left 
corner of the OSD Block which will be displayed. Outside of this box, 
no OSD will be displayed. Note that pixels are numbered in increasing 
order starting at 0. 
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The block height and block width define the height and width of the 
OSD Block (in number of pixels) which will be displayed. Outside of 
this box, no OSD will be displayed. 

A method for sending a single color update block has been provided. 
When single color is specified, only a single color is sent in the Update 
Block (as opposed to a bit-map of the specified region). The color is 
supplied in the format implied by the header. The Single Color (SC) 
bit when set specifies that the entire OSD Update Block is a single 
color. In this case, the bit-map information will contain one color in 
the format specified by the Color Resolution bits. 

An Update Block can be used to shift pixels in the specified region up, 
down, right, or left. The data to be shifted in is supplied in the bit- 
map portion of the Update Block. For example, if a 200x100 region is 
specified by the Update Block, and shift right by 10 pixels is specified, 
then the bit-map supplied with the Update Block would be 10x100. A 
two bit field specifies the shift direction. 

When asserted, the Shift bit specifies that the region specified by this 
Update Block be shifted in this specified direction by the specified 
number of pixels. The data that is to be shifted in is contained in the 
bit-map data portion of the Update Block. 

When the shift bit is set, this 9 bit shift value field specifies the 
number of pixels by which the data is shifted. The size of the bit-map 
included in the Update Block is a function of this field and the 
dimension perpendicular to the shift direction. 

§ul?-regiQn RQqyg$t 

A sub-region message 30 has also been defined which allows the 
display device 14 to request a specific portion 32 of a region 20 which 
had been previously sent (see Figure 6). This would be useful if the 
OSD had to be temporarily overwritten for an error message from a 
different device or something similar. In this way, the display device 
can request the region when needed (again keeping memory 
requirements low). 
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OSD Sub-region Request Message Encapsulation 
< — 1 ^ytg~~">< — 1 Byte — ><--- 1 Byte — >< — 1 Byte — > 



cTs=ih H^H 


APDU=EOh 


Context ID=90h??? 


Object ID = 03h??? 


Method ID = 46h 


IV ID = 6Ch 


Delimiter = F5h 


Delimiter = F5h 


Data start = F4h 


Data length = 38h 


Escape = F6h 


OSD_sub- 
region_request 


OSD_su b-region_request 


OSD_sub-region_request 


End of 
Conimand=F9h 



1 Quadlet 



The field "OSD_sub-region_request" consists of the following 
information: 

Table 1 - OSD Trigger Message Format 



SR Row 


i SR Column 


i SR Heiaht 


SR Width 




2 Bytes 


2 Bytes 


2 Byte 


2 Bytes 



SR_Row: Number of row from the top (top row being 0 relative to 
the top of the Region requested by the target for OSD 
usage). 

SR_Colunm: Number of column from the left (left column being 0 

relative to the left of the Region requested by the target 
for OSD usage). 

SR_Height: Height of Subregion in number of rows (Must be less than 
the number of rows in the OSD Region). 

SR_Width: Width of Subregion in number of columns (Must be less 
than the number of columns in the OSD Region). 

If SR_Height = SR_Width = 0, then the request shall be interpreted as 
a request to resend the Main OSD Header and the color map. 

All targets capable of generating an OSD shall implement an OSD Sub- 
region Object as defined below. Display devices communicate the 
applicable sub-region by specifying the row/column coordinates of 
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the upper left corner of the region and the width and height. The 
message syntax which goes into a FCP frame as defined by lEC 61883 
is shown below. 

Display In formation 

The following message has been defined to allow the display device to 
inform the target that the display format has changed. The display 
format (along with other information) will also be available to be read 
by the target at any time. The feedback provided from the display 
device to the target may consist of what the entire OSD bit- map plane 
is (usually the same as the display format) and what portion of the 
plane has overlapping video. For example, the OSD bit-map plane 
may be 1920X1080, but if the incoming video is 640X480 with a 4:3 
aspect ratio, then the resultant video may be displayed as 1280X960 
with the upper left hand corner of the video at coordinate (319,59). 



Display Information 



< 1 Byte >< 


-- 1 Byte --><- 


-- 1 Byte — X- 


- 1 Byte — > 


FCPCTS=lh ■■■■ 


APDU=EOh 


Context=90h 


Obiect ID=04h 


Method ID = 46h 


IV ID = 6Ch 


Delimiter = F5 


Delimiter = F5 


Data start=F4h 


Datalength=3136h 


Escape=F6h . 


Bit-map Resolution/Location and Video Location 


Bit-map Resolution/Location and Video Location 


Bit-map Resolution/Location and Video Location 


Bit-map Resolution/Location and Video Location 


End ofCommand=F9h 




zero pad 





1 Quadlet 



Bit-map Resolntion/Location and Video Location Field 



Horizontal full screen bit-map 
dimension (pixels) 


Vertical Full screen bit-map 
dimension (pixels) 


OSD Region starting column position 


OSD Region starting row position 


Width of Displayed Video (pixels) 


Height of Displayed Video (pixels) 


Video starting column position 


Video starting row position 



1 Quadla 



Application Control Language? 

In order for a consumer electronic device to interact with other 
devices interconnected via a IEEE 1394 serial bus, a common set of 
commands must be defined. Three standard approaches for device 
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modeling and control are CAL, AV/C and the approach adopted for the 
Universal Serial Bus (USB). 

The design of control languages is based on the assumption that all 
consumer electronic products have a hierarchical structure of common 
parts or functions. CAL and AV/C are control languages that 
distinguish between logical and physical entities. For example, a 
television (i.e., a physical entity) may have a number of functional 
components (i.e., logical entities) such as a tuner, audio amplifier, etc. 
Such control languages provide two main functions: Resource 
allocation and Control. Resource allocation is concerned with 
requesting, using and releasing Generic Network resources. Messages 
and control are transported by the FCP as defined in IEC-61883 and 
discussed above. For example, CAL has adopted an object base 
methodology for its command syntax. An object contains and has sole 
access to a set number of internal values known as instance variables 
(FV). Each object keeps an internal list of methods. A method is an 
action that an object takes as a result of receiving a message. When a 
method is invoked, one or more IVs are usually updated. A message 
may consist of a method identifier followed by zero or more 
parameters. When an object receives a method, it looks through its 
list of methods for one which matches the method identified in the 
message. If found, the method will be executed. The parameters 
supplied with the message determine the exact execution of the 
method. 

All devices that are capable of displaying OSDs must implement the 
following OSD object. This object assumes Asynchronous PULL with 
trigger message approach. This object would be carried in the trigger 
message from the target to the display device. The display device 
would then pull the menu by reading it from the target's bus mapped 
memory space. The response of this request will be used by the 
target device as an indication that the display device has read these 
update blocks. 
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OSD Update Trigger Object 



1 2 ,„ 


OSD Update Trisser Object 


\ (16) Data Memory 




The object is used for triggering the OSD mechanism in display capable 
devices. 




TV 


R/W 


Type 


Name 


Context Function 




a (61) 

b 
(62) 


R 
R 


Numeric 
Numeric 


size_of_biock 

length_of 
_record 


size of " memory _biock" in 
bytes (default value =10) 
length of current_record in 
bytes (default value =10) 




C(43) 


R/W 


Numeric 


current 
_index 


current record block pointed 
to (default value = 0) 




1(6C) 


R/W 


Data ( ) 


memory 
.block 


In each record, 6 MSBs 
contain the offset and LSB 
contains the OSD_type, 
remaining 3 bytes represent 
the length of OSD in bytes. 



All devices capable of generating the OSD must implement the 
following OSD Subregion Request Object. This object would be carried 
in the request message from the display device to the target for 
requesting a sub-region of the OSD with coordinates row and column, 
width and height. 



OSD Subregion Request Object 

I 3 OSD Sub-region Request Object \ (16) Data Memory 



The object is used for requesting a sub-region of the OSD. 



IV 


R/W 


Type 


Name 


Context Function 


a (61) 

b 

(62) 


R 
R 


Numeric 
Numeric 


size_of_block 

length_of 
_record 


size of "memory_block" in 
bytes (default value = 8) 

length of current_record in 
bytes (default value = 8) 


C(43) 


R/W 


Numeric 


current 
_index 


current record block pointed 
to (default value = 0) 


1(6C) 


R/W 


Data (8) 


memory 
.block 


hi each record, 2 MSBs 
contain the row coordinate, 
next two bytes the column 
coordinate, next two bytes 
the height and 2 LSBs the 
width of the sub-region. 



The following object is used for informing the target about the 
display. For example, the resolution and size of the OSD bit-map 
plane, and the location and size of the displayed video. 



SUBSTrrUTE SHEET (RULE 26) 
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Display Information Object 



1 4 


Display Information Object 




(16) Data Memory 




The object is used for informing the Target of the OSD and Display 
Format. 




IV 


R/W 


Type 


Name 


Context Function 




a (61) 

b 
(62) 


R 
R 


Numeric 
Numeric 


size_of_block 

length_of 
_ record 


size of "memory_block" in 
bytes (default value =16) 

length of current_record in 
bytes (default value =16) 




C(43) 


R/W 


Numeric 


current 
_index 


current record block pointed 
to (default value = 0) 




1(6C) 


R/W 


Data (16) 


memory 
_block 


In each record, 4 MSBs 
contain the full screen bit- 
map dimensions, the next 4 
bytes contain the OSD 
Region's location, the next 4 
bytes contain the size of the 
displayed video, the last 4 
bytes contain the location of 
the displayed video. 



While the invention has been described in detail with respect to 
numerous embodiments thereof, it will be apparent that upon a 
reading and understanding of the foregoing, numerous alterations to 
the described embodiment will occur to those skilled in the art and it 
is intended to include such alterations within the scope of the 
appended claims. 
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Claims 

1 . A digital apparatus comprising: 

(a) means for receiving from a periplieral device, interconnected by a 

. digital bus, bit-mapped data representative of an on-screen display associated witli 
5 said periplieral device; 

(b) means for receiving a digital stream representative of a programmed 
event; and 

(c) means for combining, in said digital apparatus, said bit-mapped data 
received from said peripheral device and said digital stream to produce a signal 

10 representative of a combined displayabie image. 

2. The digital apparatus of claim 1 further comprising: 

(a) means for receiving subsequent bit-mapped data representative of an 
updated portion of said previously received data; and 
15 (b) means for updating said combined displayabie image with said 

received subsequent bit-mapped data to produce an updated combined displayabie 
image, said updated combined displayabie image being associated with said 
peripheral device. 

20 3. The digital apparatus of claim 2 wherein a portion of said combined 
displayabie image is overwrititen, said digital apparatus further comprising : 

(a) means for requesting from said peripheral device said bit-mapped data 
corresponding to said overwritten portion of said combined displayabie image; and 

(b) means for receiving from said peripheral device said bit-mapped data. 

25 

4. The digital apparatus of claim 3 further comprising; 

means for selecting said peripheral device from a plurality of available 
peripheral devices interconnected by said digital bus. 
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5. The digital apparatus of claim 4 further comprising: 

means for notifying said peripheral device of a format change in said display 
device in response to a format change of said received digital stream. 

6. The digital apparatus of claim 5 further comprising: 

means for shifting said bit-mapped data within said combined displayable 

image. 

7. A method for managing an on-screen display menu of a peripheral device 
interconnected to a display device via a digital bus, the display device performing the 
steps of: 

(a) receiving, from said peripheral device, a message indicative of the 
characteristics of a block of bit-mapped data stored in a memory device associated 
with said peripheral device, said bit-mapped data being associated with an on-screen 
display menu of said peripheral device; 

(b) generating and providing asynchronous read request command to said 
peripheral device; 

(c) receiving, in response to said asynchronous read request command, 
said bit-mapped data from said peripheral device; 

(d) receiving a digital stream representative of a programmed event; and 

(e) combining said bit-mapped data received from said peripheral 
device and said digital stream to produce a combined displayable image, said 
combined image being representative of said on-screen display associated with 
said peripheral device. 

8. The method of claim 7 wherein said message contains the location and 
size of said block of bit-mapped data stored in said memory device. 

9. The method of claim 8 wherein said data comprises a header and a bit- 
mapped update block, said header defining the parameters of said on-screen 
display menu and said bit-mapped update block defining the location and content 
of said menu. 
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1 0. A digital television apparatus comprising: 

(a) receiving from a peripheral device, interconnected by a digital bus, bit- 
5 mapped data representative of an on-screen display associated with said peripheral 

device; and 

(b) receiving from said peripheral device, interconnected by a digital bus, 
subsequent bit-mapped data representative of an updated portion of said previously 
transferred bit-mapped data, said subsequent bit-mapped data being indexed into 

10 said previously transferred bit-mapped data. 
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Abstract of the Disclosure 

Interoperability for exchanging on-screen display menus and 
associated control between common consumer electronic (CE) devices 
is provided. This interoperability is based on the IEEE 1394 serial bus 
for the physical and link layers and makes use of AV/C or CAL as the 
control language. This invention provides for transferring a bit- 
mapped on-screen display menu constructed by a target device (e.g., 
digital VCR) to display device (e.g., digital TV). 
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manner provided by the first paragraph of Title 35, United States Code, §112, I acknowlege the duty to disclose 
material information as defined in Title 37, Code of Federal Regulations, § 1.56(a) which occurred between the 
filing date of the prior application(s) and the national or PCT international filing date of this application: 



PRIOR U S APPLICATIONS OR PCT INTERNATIONAL APPLICATIONS DESIGNATING THE U.S. FOR BENEFIT UNDER 
35U.S.C.120: 



U.S. APPLICATIONS 



5. APPLICATION NUMBER 



60/066, 782 



60/071, 341 



60/073,693 



25 November 1997 



14 January 1998 



04 February 1998 



PCT APPLICATIONS DESIGNATING THE U.S. 



^ JSCT APPLICATION NO 



PCT/US98/24687 



2 ONovember 1998 (20 



STATUS {Check one) 



POWER OF ATTORNEY: As a named Inventor, I hereby appoint the following attorney(s) and/or agent(s) to prosecute 
This application and transact all business in the Patent and Trademark Office connected therewith. (List name and registra- 
tion number) Joseph S. Tripoli - Reg. No. 26 , 0 _^ 
Robert D. Shedd - Reg. Nor^3F7jl,9 
Reg. 



Send Correspondence to: 

i^r. Joseph^ S. Tripoli - Patent^Qjserations, 
THOMSQN_mui t .ime d .i. a L x cjensji^jg_In£L. _ 
PO Box 53JJ^ 

Princetoru New J^e^sey 0 8540 US 


Direct Telephone Calls to: 
(name and telephone number) 

1-609-734-9875 




FULL NAME 
OF INVENTOR 


'stahS^'^^^ 


FIRST GIVEN NAME 

Thomas ^ 


SECOND GIVEN NAME 

Anthony 


o 


RESID|NICE& 


CITY 

Indianapol.i.s 


ST-ATrtJFTFUREiGN COUNTRY / 

Indiana -y 


COUNTRY OF CITIZENSHIP 

US 




POST OFFICE 
ADDRESS 


POST OFFICE ADDRESS 

7^03 Stewart Court 


CITY — ' " 

Indianapolis 


STATE 8. ZIP CODE/COUNTRY 

Indiana 46256 US 




FUL'fmME// 

ofj^rTOr' 


bMaiLY NAME 

^ chatteroee . 


FIRST GIVEN NAME 

Amit 


_gymar 


o 


RESIDENCE 8. 
CITIZENSHIP 


CITY 

North Andover 


jTfffE OR FOREIGN COUNTRY /} / /} 

Massachusetts /// y-p 


COUNTRY OF CITIZENSHIP 
IN 




POST office 
ADDRESS 


■POST OmCE-WBOTESS 

34 Rosemont Drive 


CITY /" • 

North Andover 


STATE & ZIP CODE/COUNTRY 

Massachusetts 01845US 




O-F^^rf^ 


FAMILY NAME 

IZZAT 


FIRST GIVEN NAME 

Izzat / 


SECOND GIVEN NAME 

Hekmat 


o 


RESjDENCE& 


CITY 

Carmel 


STATE-effTO'R'erGN COUCUS^ / 

Indian^__/-»A/ 


CQUNXffY-«EXiHfSNSHIP 

Iraq 




POST OFFICE 
ADDRESS 


POST OFFICE ADDRESS 

2249-6 East 151 Street 


CITY 

Carmel 


STATE St ZIP CODE/COUNTRY 

Indiana 46033 US 



1 hereby declare that all statements made herein of my own knowledge are true and that all statements made on 
information and belief are believed to be true; and further that these statements were made with the knowledge 
that willful false statements and the like so made are punishable by fine or imprisonment, or both, under section 
1001 of Title 18 of the United States Code, and that such willful false statements may jeopardize the validity ot 



Thomas kfithony *.etahl 


SIGNATURE OF INVENTOR 202 

Amit Kumar Chatter jee 


VSIG6IATURE OF INVENTOR 203 jj , Jl 

Izzat Hekmat Izzat 


DATE . 

. CJUm^^^^-^^'^^ ^ 2000 


DATE / 

2 000 


DATE 

"X 8/ 2_g / 2000 

U S DEPARTMENT OF COMMERCE-Patent and Trademark 0<fice 



RCA 88863 



COMBINED DECLARATION FOR PATENT APPLICATION AND POWER OF ATTORNEY 
(Continued) 





I fiu nam€\ 


FAMILY NAME 

KURUGAY 


FIRST GIVEN NAME 

SAB AN 


SECOND GIVEN NAME 


^CITIZENSHIP 


Waukesha 


Wisconsin j^f 


TR 


'mST Of FCI 
lyOORESS 


posroPfiCE a'oobeSS" 

302 West North Street, A 


3t.20 Waukesha 


Wisconsin 5318a US 


i 

c 




NAG I PAL 


FIRST GIVEN NAME 

SANJEEV 


SECOND GIVEN NAME 




Boulder 


rrST-E OR FOREIGN COUNT^ ^v. 

Colorado ) 


IN 


a»0ST OFRCE- 


4 93 0 Meredith Way, Apt. 3 


05 Boulder 


Colorado 80303 US 


k 


/ |f1j|ll name 
^e(f?^lvENTOR 


FAMILY NAME 

TRZYBINSKI 


FIRST GIVEN NAME 

Robert / 


SECOND GIVEN NAME 

EjAgene 


RfSIOENCE« 
CITIZENSHIP 


CI TV 

Indianapolis 


STATE-SR FOREIGN COUNTRY^ j,! 

Indiana ^~TZ/li 


US 


POST OFFICE 
ADDRESS 


£0ST-eFfteE-«30«£SS 

77 41 North Sherman Driv 


2 Indianapolis 


Indiana 46240 US 



I hereby declare that all statements made herein of my own knowledge are true and that all sutements made on 
information and belief are believed to te true; and further that these statements were made with the knowledge 
that willful false statements and the like so made are punishable by fine or imprisonment, or both, under section 
1001 of Title 18 of the United States Code, and that such willful false statemenu may jeopardize the validuy of 
the application or any patent issuing thereon. 



. SIGNATURE OF INVENTOR 2q4 

Saban jCnt^mgay- 



DATE / 



ATUBE OF INVENTOR 2C^ 

Sanjeev Nagip^ 



SIGNATURE Of INVENTOR 206 

Robert fii^ene Trzybinski 



2000 



,.3oi3 



US DEPARTMENT Of COMMERCE Paie"! 



RCA 88863 



COMBINED DECLARATION FOR PATENT APPLICATION AND POWER OF ATTORNEY 
(Continued) 





i PllU NAMC 
'pf INVENTOR 


FAMILY NAME 

KURUGAY 


FIRST GIVEN NAME 

SABAN 


SECOND GIVEN NAME 


: RESIDENCE & 
■=CITIZENSH* 


CITY 

Waukesha 


STATE OR FOREIGN COUNTRY 

Wisconsin 


COUNTRY OF CITIZENSHIP 

TR 


:;i>GST OFFICE 
lUDORESS 


POST OFFICE ADDRESS 

302 West North Street, A 


CITY 

Dt.20 Waukesha 


STATE & ZIP CODE/COUNTRY 

Wisconsin 5318a US 


tn 
o 


^Hia NAME 
pr INVENTOR 


FAMILY NAME 

NAG I PAL /VAG\PAL 


FIRST GIVEN NAME 

SANJEEV 


SECOND GIVEN NAME 


^SIOENCE & 
CITIZENSHIP 


CITY 

Boulder i-Ovic^-nnOTr>+ 


^TAfE OR FOREIGN COUNTRY 

Colorado 


COUNTRY OF CITIZENSHIP 

IN 


^E^f 


4 03 0 Meredith Way, Apt. 3 


0-5 Boufder 


STATEaZIPC00£/COUI^RYg.p-j ^^-fe*^ 

Colorado 8^303 US 


VD 
O 
<N 


rHJLL NAME 
"OF INVENTOR 


FAMILY NAME 

TRZYBINSKI 


FIRST GIVEN NAME 

Robert 


SECONO GIVEN NAME 

Eugene 


laiisiOENCE & 
CITIZENSHIP 


CITY 

Indianapolis 


STATE OR FOREIGN COUNTRY 

Indiana 


COUNTRY OF CITIZENSHIP 

US 


POST OFFICe 
ADDRESS 


POST OFFICE ADDRESS 

77 41 North Sherman Driv 


e Indianapolis 


STATE & ZIP CODE/COUNTRY 

Indiana 4 6240 US 



I hereby declare that all statements made herein of my own knowledge are true and that all sutements made on 
information and belief are believed to be true; and further that these statements were made with the knowledge 
that willful false statements and the like so made are punishable by fine or imprisonment, or both, under section 
1001 of Title 18 of the United States Code, and that such willful false statements may jeopardize the validity of 
the application or any patent issuing thereon. 



(A TUBE OF INVENTOR 2o4 

y 

Saban Kurugay / 



^San"Jebv Nagipa-a. a/c.^!:^! 



SIGNATURE OF INVENTOR 20 6 

Robert Eugene Trzybinski 



S DEPARTMENT OF COMMERCE Piie"! 



* 

RCA 8 8863 " 



COMBINED DECLARATION FOR PATENT APPLICATION AND POWER OF ATTORNEY 
(Continued) 



o; 


y FULL NAME 
|f)F INVENTOR 


FAMILY NAME 

KURUGAY 


first given name 
SABAN 


SECOND GIVEN NAME 


fllESIOENCE & 
^CITIZENSHIP 


CITY 

Waukesha 


state or foreign country 

Wisconsin 


COUNTHY Of CITIZENSHJP 

TR 


==PQST Of Fce 
. ADDRESS 


post office address 

302 West North Street, A 


CITY 

Dt.20 Waukesha 


STATE & ZIP CODE/COUNTRY 

Wisconsin 5318a US 


tn 
o 


ZfUll NAME 
lJ)F INVENTOR 


family name 
NAGIPAL 


FIRST GIVEN name 

SANJEEV 


SECOND GIVEN NAME 


^RESIDENCE li 
yJCITIZENSHIP 


citv 
Boulder 


. T a TE OR FOREIGN COUNTRY 

Colorado 


COUNTRY OF CITIZENSHIP 

IN 


= ==?OST OFFICE 
AOOBESS 


post office address 

4930 Meredith Way, Apt, 3 


CITY 

05 Boulder 


STATE & ZIP CODE/COUNTRY 

Colorado 80303 US 


o 


^JfInventor 


family name 
TRZYBINSKI 


FIRST GIVEN NAME 

Robert 


SECOND GIVEN NAME 

Eugene 


r=BES10ENCE » 
==CITIZENSHIP 


Indianapolis 


STATE OR FOREIGN COUNTRY 

Indiana 


COUNTRY Of CITIZENSHIP 

US 


POST OFFICE 
AOOBESS 


post office address 

7741 North Sherman Driv 


a Indianapolis 


STATE & ZIP CODE/COUNTRY 

Indiana 46 240 US 



I hereby declare thai all statements made herein of my own knowledge are true and that all statements made on 
information and belief are believed to 4je true; and further that these statements were made with the knowledge 
that willful false statements and the like so made are punishable by fine or imprisonment, or both, under section 
1001 of Title 18 of the United States Code, and that such willful false statemenu may jeopardize the validity of 
the application or any patent issuing thereon. 
;g 



SIGNATURE OF INVENTOR 



Saban Kurugay 



SIGNATURE OF INVENTOR 2c5 

Sanjeev Nagipal 



U S OEPABTMENT 01 



